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ON  THE  CYCLIC  BEHAVIOR  OF  RANDOM  TRANSFORMATIONS 
ON  A  FINITE  SET 

by 

Alan  E.  Gelfand 


1.  Introduction 

Let  X  •  (x^ » • • • * xn )  be  a  set  of  n  elements  and  let 

be  the  set  of  all  transformations  from  X  into  itself.  For 

-  1/ 

T  £  we  take  T  to  have  its  usual  meaning.  Suppose  for  any 
x  e  X  we  look  at  the  sequence  TJx  ,  J  ■  0,1,2,...  (T°x  =  x)  . 
Since  X  is  finite,  given  an  arbitrary  initial  element,  the 
sequence  T^  must  eventually  encounter  an  element  it  had  shown 
before.  Doing  so,  it  must  thereafter  repeat  the  Intermediate 
sequence  of  elements.  Such  a  sequence  of  elements  is  called  a 
cycle.  The  number  of  distinct  elements  In  the  cycle  is  called  the 
cycle  length.  For  a  given  x  and  a  given  T  there  will  thus  be 
one  and  only  one  cycle,  say  of  length  r  (which  we  may  call  the 
cycle  associated  with  x  ).  Then  for  any  x'  on  this  cycle 

mr 

T  x'  *  x*  ,  m  •  0,1,2,. . .  . 

But  for  a  given  T  not  all  elements  in  X  must  be  on  a  cycle. 
Some  elements  may  be  transient  in  that  they  occur  during  a  run-in 
period  prior  to  T  falling  into  a  cycle.  Moreover,  starting  from 
differing  x’s  may  lead  T  to  fall  into  differing  cycles,  i.e. 
there  may  be  many  cycles  associated  with  T  .  This  leads  to  the 
notion  of  a  cycle  space  for  T  .  The  number  of  cycles  is  obviously 
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between  1  and  n  as  is  the  number  of  cyclic  elements  (l.e., 
elements  on  some  cycle). 

For  the  transformation  T  with  n  *  10  given  by 


X 

X1 

X2 

x3 

XH 

x5 

x6 

x7 

x8 

X9 

O 

r“H 

X 

Tx 

X5 

x8 

X1 

x8 

X9 

x6 

X10 

x4 

X1 

X9 

we  may  graphically  describe  the  cycle  space  as 

x3  X2 

*  > — ^4  + 


It  is  the  purpose  of  this  paper  to  develop  a  collection  of 
results  which  effectively  describe  the  cycle  space  of  a  randomly 
selected  T  .  The  application  of  these  results  to  the  study  of 
systems  having  a  finite  number  of  states  is  apparent  and  for  this 
reason  we  will  use  the  term  "state"  interchangeably  with  the  term 
"element . " 

The  extant  literature  in  this  area  is  quite  limited.  Gontcharoff 
in  some  early  work  considers  the  distribution  of  cycles  in  permuta¬ 
tions  of  a  finite  number  of  elements.  Rubin  and  Sitgreaves,  in  a 
very  long  and  detailed  article,  consider  some  aspects  of  the  cycle 
space  without  formally  recognizing  it.  Harris  extends  their  work 
and  Includes  some  results  discussed  here  but  obtained  from  a  differ¬ 
ent  point  of  view.  Katz  and  his  student,  Folkert,  examine  the 
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expected  number  of  cycles.  Cull  studies  the  problem  in  a  system 
setting  (in  particular,  using  binary  switching  nets  although  to 
no  particular  advantage)  and  develops  some  results  (with  a  few 
errors)  on  the  expected  number  of  cycles  and  cyclic  states. 

Our  format,  then,  is  as  follows.  In  section  2  we  formalize 
the  problem  developing  convenient  notation  and  definitions.  In 
section  3  we  introduce  random  transformations.  In  section  *1  we 
demonstrate  the  advantage  of  viewing  the  problem  in  terms  of 
square  arrays  of  row-exchangeable  variables.  In  section  5  we  offer 
exact  results  for  fixed  n  and  in  section  6  we  present  some 
attractive  asymptotic  results. 


2.  The  Setup 

Consider  again  a  finite  set  X  with  elements  x1,x2,...,xn  . 
Any  transformation  T  eJ  from  X  into  itself  may  be  given  a 
matrix  representation  through  an  n*n  transition  matrix  which  we 
shall  also  denote  by  T  .  That  is 


1  if  state  x 1  is  the  successor  to  state  Xj  , 
i.e.  TXj  *  x^ 

0  otherwise. 


By  definition  T  has  exactly  one  ”1"  per  column.  Suppose 
T  results  in  a  cycle  space  having  k  transient  elements  and  m 
cycles  of  lengths  ri »r2,r3 *  * • • »rm  »  respectively.  Consider  the 
characteristic  polynomial  of  T  ,  |T  -  XI |  where  operations  are 


3 


F 


performed  in  the  real  field.  It  is  straightforward  to  show  that 
this  polynomial  will  have  the  form 

k  m  ri 
+  XK  n  (X  1  -  1) 

i*l 

(see  Cull  for  further  details). 

In  the  T  matrix  we  can  see  that  we  have  *  1  i.f.f. 

state  i  is  on  a  cycle  of  length  1.  Thus  Tr(T)  gives  the  number 
of  elements  on  cycles  of  length  1.  Extending  this  notion  it  is 
apparent  that 

(1)  TrCT111)  *  number  of  states  on  cycles  whose  length  divides  m  . 
n  * 

Hence  Tr (T  ')  equals  the  number  of  states  on  cycles  and 
* 

n  -  Tr(T  *)  equals  the  number  of  transient  states. 

It  is  of  interest  to  obtain  a  matrix  from  T  such  that 

m 

Tr(Am)  ■  number  of  states  on  cycles  whose  length  is  exactly  m  . 

Let 

Cm  "  (primes  <  m  which  appear  in  the  prime  representation  of  m} 
(i.e.  appear  with  a  power  1) 


and  let 

N  ■  number  of  elements  in  C_  . 

m  in  i 

i 
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The  number  of  subsets  of  N  Is  2  m  and  the  number  of  subsets 

N  m 

of  size  k  is  (kra)  =  Nmk  .  At  a  given  k  let  J  index  the 

N 

subsets  of  size  k  so  that  the  2  m  subsets  may  be  denoted  by 
Ckj  »  k  *  0,1,2,... ,Nm  ,  J  »  1,2,...,  Nmk  .  Let  gkJ  equal  m 
dived  by  the  product  of  all  the  elements  in  Ckj  .  Then 


Theorem.  Por  each  m  ,  m  *  l,2,...,n  ,  let 

N  N 


(2) 


m 


a*  »»« 

m  i,  mk  g.  . 

-  E  (-1)  E  T  KJ  . 
k-0  J-l 


Then  Tr(Am)  ■  number  of  states  on  cycles  whose  length  is 
exactly  m  . 

Proof.  The  most  direct  proof  employs  a  straightforward,  but 
tedious,  inclusion-exclusion  argument. 


3.  Random  Transformations. 

Consider  now  the  selection  of  a  random  (equally  likely)  trans¬ 
formation  T  from  J  .  This  selection  is  conveniently  accomplished 
as  a  sequence  of  n  independent  multinomial  trials  where  the  Jth 
trial  chooses  the  successor  to  state  j  in  an  equlprobable  fashion 
from  amongst  the  n  elements  in  X  .  This  approach  clearly  results 
in  an  equlprobable  selection  of  the  nn  elements  in  J  . 

Then  Tr(T)  ,  the  number  of  states  on  cycles  of  length  1,  is 
obviously  distributed  as  binomial  (n,  with  E(Tr(T))  ■  1  , 
var(Tr(T))  «  (n-l)/n  .  The  probability  that  T  has  no  cycles  of 
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length  1  is  ((n-l)/n)n  ;  the  probability  that  state  i  is  a  successor 
state  is  1  -  (<n-l)/n)n  .  As  n  •*  »  these  probabilities  tend  to 
e-^-  and  1  -  e”1  ,  respectively.  More  generally  the  limiting  dis¬ 
tribution  of  Tr(T)  is  Poisson  (1). 

We  now  examine  the  nature  of  the  cycle  space  of  a  random 
transformation.  In  particular,  we  pose  the  following  questions. 

(i)  What  is  the  probability  that  state  x ^  is  on  a  cycle  of 
length  r  ? 

(ii)  What  is  the  Joint  probability  that  state  x1  is  on  a 
cycle  of  length  r  and  state  x^  is  on  a  cycle  of 
length  s  ? 

(iii)  What  is  the  expected  number  of  cycles  of  length  r  and 
the  expected  number  of  states  on  cycles  of  length  r  ? 

(iv)  What  is  the  distribution  of  the  number  of  cycles  of 
length  r  and  of  the  number  of  states  on  cycles  of 
length  r  ? 

(v)  What  is  the  Joint  distribution  of  the  number  of  cycles  of 
length  r  and  the  number  of  cycles  of  length  s  ?  of  the 
number  of  states  on  cycles  of  length  r  and  the  number  of 
states  on  cycles  of  length  s  ? 

(vi)  What  is  the  expected  number  of  cycles  and  the  expected 
number  of  states  on  cycles? 

(vii)  What  is  the  distribution  of  the  number  of  cycles  and  of 
the  number  of  states  on  cycles? 

(viii)  What  is  the  expected  length  of  a  cycle? 
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In  what  follows  we  shall  provide  exact  or  asymptotic  answers 
to  all  of  these  questions.  Some  aspects  of  this  distribution  theory 
(e.g.  (iv),  ( vii )  and  (viii))  have  been  studied  by  Rubin  and 
Sitgreaves  and  by  Cull.  However,  the  distribution  of  Tr(Tk)  and 
Tr(Am)  as  in  (1)  and  (2)  are  extremely  difficult  to  examine 
directly.  In  the  next  section  we  will  show  how  an  approach  using 
a  sequence  of  square  arrays  can  be  employed  advantageously  in 
answering  the  above  questions. 


•  Square  Arrays. 

For  a  set  X  of  n  elements  and  T  selected  at  random  from 
J  consider  the  n*n  array  of  random  variables. 


(3) 


where 


D 


n 

11 

)n 

'21 


D 

D 

D 


n 

In 

n 

2n 


n 

nn 


Dn  ■  (  1  if  state  x^  is  on  a  cycle  of  length  r 

rl  '0  otherwise. 

From  this  array  we  are  interested  in  the  following  variables. 

n 

(4)  S„  *  E  D”.  ■  number  of  states  on  a  cycle  of  length  r 
n*r  ri 


7 


(5)  r  ■  Sn  p/r  *  number  of  cycles  of  length  r 

(6)  Cn  •  E  Dn  ■  I  1  if  state  is  on  a  cycle 

1  r*l  rl  '  0  otherwise 

n  n  n 

(7)  U  *  E  S  ■  E  c"  *  number  of  states  on  cycles 

n  r*l  n,r  1*1  1 

n 

(8)  V  *  E  T  „  *  number  of  cycles. 

n  r*i  n>r 

Note  that  while  a  row  sum  (S„  _)  may  exceed  1,  by  definition 

n,r 

the  column  sums  (c”)  are  still  0-1  random  variables.  In  fact, 

P(C^  »  0)  is  the  probability  that  state  i  is  transient. 

For  any  fixed  r  the  Joint  distribution  of  Dn. , . . . ,Dn  or 

rl  rn 

of  any  subset  will  be  that  of  a  collection  of  dependent  interchange¬ 
able  random  variables.  The  marginal  distribution  of  any  Dpl  is 
given  by 

(9)  P(Dpl  *  1)  *  P(state  x^  is  on  a  cycle  of  length  r) 

.  (n-l*(r-l)I  1  g  1  (n)r 

r-1'  r  n  r 

n  n 

where  (n)p  is  the  falling  factorial  of  r  terms  starting  at  n  . 
Thus  we  immediately  have  E(Dpl>  and  var(Dpl>  and  may  note  that 
as  n  »  both  tend  to  0. 

We  can  immediately  obtain  the  expectation  of  the  variables  in 
(4)  through  (8),  i.e. 

(10)  ’  (Sn,r)  * 
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(11) 

E  ( T  ) 

n,r 

1 

m  — 

r 

(12) 

E(CJ)  - 

i  1 
n  r! 

(13) 

E(un)  - 

n 

Z 

k*l 

(1*0 

E<V  - 

n 

Z 

r*l 

E  (n)r/n 


i  (n> ,/nr 
v  v 


The  limits  of  (10)  and  (11)  are  clearly  1  and  1/r  , 
respectively.  By  truncating  the  sums  at  arbitrary  m  and  letting 
n  -*•  *  ,  the  limits  in  (13)  and  (14)  are  both  seen  to  be  •  .  For 
(12)  the  limit  is  0  ,  i.e.  fixing  m  <  n  we  have 


m-1 

(n) 

Z 

1-1 

r 

nr 

♦ 

m 

nmtl  . 

m-1 

(n) 

(n) 

z 

r 

+ 

m 

i-1 

nr 

nm*l 

m-1 

(n) 

Z 

r 

+ 

m  1 

i-1 

nr 

mnm 

rn-m.n-m+l 

i~n~ 


1  -  (2=*) 


[1  -  (1  -  Ejn-m+lj 


As  n  ■*  «  the  right-hand  side  approaches  —  (1  -  e~m)  .  But 


m  is  arbitrary  so  that  the  limit  of  the  left-hand  side  must  be  0  . 

The  interpretation  of  these  limits  is  that  (i)  the  probability 
of  any  particular  state  being  on  a  cycle  tends  to  0  with  increas¬ 
ing  number  of  states,  but  (li)  the  expected  number  of  cyclic  states 
and  expected  number  of  cycles  tends  to  *  with  increasing  number  of 
states. 
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Consider  the  Joint  distribution  of  any  pair,  Dn.  ,  Dn.  . 

ri  s  j 

We  have  three  cases:  (1)  r  +  s  ,  1  j*  j  ,  (11)  r  -  s  ,  1  j*  J  , 
(ill)  r  W  s  ,  1  *  j  . 

For  (1)  we  have 


U5)  -  1  ,  Dj  -  1) 


1 

n(n-l) 


(n) 


r+s 


n 


r+s 


0 


r  +  s  <  n 

r  +  s  >  n 


For  (11)  we  have 


(16)  P(D"1  «  1  ,  Djj  -  1) 


(r-1 )  (n)r  1 _  (n)2r 

n(n-l)  nr  n(n-l)  n2r 

(r-l)  (n)r 
n(n-l)  nr 


2r  <  n 


2r  >  n 


For  (ill)  we  have  two  exclusive  events  so  that 


(17)  P(D"1  •  1  ,  Dj4  ■  1)  •  0  . 


In  each  case  using  (9)  we  may  obtain  expressions  for  the  three 
remaining  Joint  events. 


Continuing  we  have  in  case  (1) 


(18)  cov(Dj1  ,  D^) 


1 


n(n-l) 

1 


(n) 


r+s 


r+s 

n 

(n)r(n)s 


n 


r+s 


(n)  (n) 
r  s 

r+s 

n 


r  +  s  <  n 


r  ♦  s  >  n 
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In  case  (11) 


(19)  cov(D"1,D"J) 


r-1 

(n)r 

+  -J- 

<n)2r 

1 

C(n)r32 

n(n-l) 

nr 

n  (n 

^TT  2r~  ' 

'.7 

n2r  * 

(r-1) 

<n)r 

1 

C(n)r]2 

n(n-l) 

r 

n 

'  n2 

n*r 

> 

and  In  case  (111) 


(20)  covCdJIj.dJj) 


n2  nr+s 


,  2r  >  n 


In  all  cases  these  covariances  tend  to  0  as  n  *  ,  a  fact 
which  could  be  Inferred  without  computation  from  the  Cauchy-Schwarz 
Inequality  and  (9). 

Hence 


(2i)  co.(Snr,Sn8) 


(n)rts  <n>r(n)s 


n 


r+s 

(n>r(n>s 


n 


r+s 


n 


r+s 


,r/s  ,  r  +  s  <  n 


,  r  ?  s  ,r  +  s>n 


(22)  cov(Tnir,T^s)  -  —  cov(Snjr,Sn>s) 


(23)  var(Sn>r)  » 


M  <">n  +  <n>2r 
r  (n)r  C(n)r]2 


n 


n 


2r 


2r  <  n 


2r  >  n 


(2J O  var(Tn>r) 


7  var(Sn,r> 
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(25) 

cov(cj.cj)  - 

2 

n 

(r-1) 

(n)r 

■»  n  <n) 

‘  1?  ‘r-1  ~ 

n(n- 

r 

n 

(26) 

var(cj)  -  ^ 

n 

E 

r®l 

<">r 

nr 

|<M 

^h|  c 

n 

E 

r*l 

(Or  |2 
nr  1 

n 


(n). 


(27)  var(Un)  -  E  (2r-l)  — -  (  e 


n  (n)  2 


r*l 


n 


r«l  n 


n  i  (n)„ 
(28)  var (V  )  -  E  i  — £■ 
n  r-1  r  nr 


(  r  i.  _ L  )  +  r  1  -  r+S 

'  r  r,r  r.  Ll  rs  „r  +  S 

r*i  n  r,s>l  n 

r+s<n 


From  these  expressions  it  is  clear  that  S  and  S 

n  ,r  n ,  s 

(also  Tn>r  and  Tn,s  ^  are  always  negatively  correlated  but 

asymptotically  uncorrelated.  Also  lim  var(S  )  ■  r  , 

n  +  *>  n,r 

lim  var(Tn  p)  =  1/r  .  It  is  also  apparent  that  lim  var(c|?)  •  0 
n  •  *  .  n  -*•  “»  1 

and  thus  that  lim  cov(c"  C?)  -  0  .  Finally,  var(U  )  and  var(V  ) 
n  -►  ®  1  J  n  n 

both  tend  to  «  as  n  -*■«*,  as  will  be  most  easily  seen  from  results 

in  section  6. 

Extending  cases  (i),  (ii)  and  (iii)  above,  consider  any  subset 
of  size  m  of  the  .  Suppose  first  that  all  m  variables  are 

in  the  same  row  of  (3).  Taking  mr  n  and  recognizing  the  exchange¬ 
ability  of  the  variables,  we  seek 


Pn,m,r  *  P^Dra.  "  Dro-  “  •"  D 


n 

ra. 


1) 


m 


■  P( states  x  ,x  . x  are  each  on  a  cycle  of 

1  2  m 

length  r). 
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To  obtain  an  expression  for  this  probability,  consider  all 
possible  partitions  of  m  with  no  part  greater  than  r  .  If  a 


given  partition  has  parts  ,  let  n(m^,...,mj)  be  the 

number  of  ways  to  allocate  m  distinct  objects  into  J  like  cells 

with  in  cell  i  *  m)  •  Also  associate  with 

m1,m2,...,mj  the  event  Anr^mi *  *  *  * »mj ^  defined  by  {states 

x  ,...,x  on  the  same  cycle  of  length  r  ,  states  x  . 

°1  mx  am1+l 

x  on  the  same  cycle  of  length  r  ,  etc.}.  If  is  the 

am1+m2  m 

set  of  all  partitions  of  m  and  r  is  the  set  of  all  partitions 

of  m  with  no  part  greater  than  r  ,  then 


(29) 


_  ”  £  n(m, , • . •  ,m . )  P(A  #  m  \ 

n , m , r  n  1  J  nr \ m  ~ , m  ^  > . . *  >  m . j 

^m.r  l  j 


with 


(30) 


P(  A 


nr(m1 ,m2 


n'^r  [  (r-1 )  1  DJ 


J  -1 

[  n  (r-m  ) : ]  1 

i-1  1 


Using  (29)  with  appropriate  subsets  of  size  m-1  ,  we  may  in 
principle  obtain  the  complete  Joint  distribution  of  the  m  D 

r  i 

If  on  the  other  hand  the  m  Dn.  are  all  in  the  same  column  of 

ri 

(3)»  say  Dn  Dn  .  ,  in  accordance  with  (17)  their  Joint  dis- 

“l1  “m1  1  (n) 

tribution  will  be  multinomial  with  associated  P  *  -  . — , 

a3  "  nJ 

J  *  1  f  •  •  •  fin  • 


Extending  the  above  ideas,  we  may  obtain  the  Joint  distribution 
of  any  subset  of  size  m  of  . 
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5.  Exact  Distributions 

Returning  to  the  variables  in  (4)  -  (8),  we  have  already  noted 

that  Cj  is  a  0-1  variable  with  success  probability  given  by  (12). 

Next  we  obtain  the  exact  distributions  of  U  following  ideas 

n 

given  by  Rubin  and  Sitgreaves.  Given  T  ,  for  any  x  e  X  ,  we  can 
define  the  set  of  all  successors  to  x  ,  S(x)  ,  l.e. 

S(x)  ■  (x':  Trx  ■  x’  for  some  r  >  0). 

By  definition  x  e  S(x)  and  S(x)  includes  all  the  cyclic 
states  associated  with  x  (although  x  is,  of  course,  not  necessary 
cyclic).  Then  with  k  >  r  +  1 

P(x  has  k  successors,  S(x)  has  cycle  of  length  r,  x  is  not  cyclic) 

•  P(Tx  f  x  ;  T2x  /  Tx  ,  T2x  t  x  ;  T3x  *  T2x  ,  T3x  *  Tx  ,  T3x  t  x  ; 

Tk_1x  *  Tk~2x,...,Tk'1x  *  x  ;  Tkx  -  Tk~rx) 

m  Uzl  .  Uzl  .....  n  .  1 

n  n  n  n 

(n)^ 

nktl  ‘ 


Thus 


(31) 


P(S(x)  has  cycle  of  length  r,  x  is  not  cyclic) 


n 

E 


(n). 


k-r+1  n 


k+1 
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But 


P(S(x)  has  cycle  of  length  r,  x  Is  not  cyclic) 


n 


■  I  P(S(x)  has  cycle  of  length  r,  x  is  not  cyclic,  U  ■  u) 


u=r 


n 


n 

■  E  P(S(x)  has  cycle  of  length  r|x  is  not  cyclic,  U  ■  u) 
u«r  n 

P(x  is  not  cyclic|Un  *  u)  P(L'n  »  u) 


l  (1 


u*r 


u-1  .  u-2  u— ( r— 1 )  1  v  _  n-u  D.„  _  v 

u  u-1  ***  u-(r-2)  u-(r-l)  ^  n  ’  P  Un  “ 


(32) 


jr  &  P<Un  '  “> 


Now  (31)  and  (32)  are  equal  for  all  r  implying 


n 

E 


(n), 


k«r+l  n 


k+1 


n 

E 


(n), 


k«r+2  n 


k+1 


n 

E 

u«r 


S=H.  P(U  -U) 

nu  n 


n 

E 

u=r+l 


2=H.  p(U 
nu  n 


u) 


from  which 


(33) 


P(U  -  u) 


(n)uu 

u+1 

n 


,  u  ■  1 ,2, .  . .  ,n 


P  * 

Prom  (33) »  P(Un  *  n)  *  — pj  •  This  is  seen  directly  by  noting 

n 

that  U  *  n  i.f.f.  T  is  1-1  and  that  there  are  n!  such  T  . 
n 

Harris  offers  an  alternative  development  of  (33)  by  decomposing  the 
cycle  space  of  T  and  employing  a  convenient  identity  from  Katz. 
Using  (33)  we  have  the  identity 

n  (n). 


(3D 


u 


u  ■  n 


u«l  n 
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Taking  the  mean  of  Un  from  (33)  and  equating  to  (13)  we  have 
the  identity 

n  (n)  ,  n  (n)  2  , 

(35)  Z  —rr  “  £  £  "T  u  or  n  E(~TT^  *  E<un)  • 

u-1  nu  n  u-1  nu  Un  n 

Continuing  in  this  fashion,  from  (27)  we  have 

2  n  (n)u  n  (n)u 

(36)  E(U;)  *  Z  (2u-l)  ±  »  2n  -  E  — -  or 

n  u-1  n  u-1  n 

E(U2)  «  2n  -  E(U  ) 
n  n 


and  hence  the  identity 


(37) 


n  (n)  u- 
E  •  u 


n  (n) 


u*l  n 


u 


-  2n  -  n  E 


u 


n  (n) 


u-1  n 


u 


2n  -  E 


*u2 


u-1  n 


Note  that  n_1E(U2 )  -►  2  . 


The  exact  distribution  of  V  is  obtained  from  U  by 

n  n 

n  t 

P(Vn  -  v)  -  E  P(Vn  -  v|Un  -  u)  P(Un  -  u) 
u— v 

n  (n)  u 

(38)  «  E  a  (u.v)  -u^-  • 

u-v  n 

But  it  is  clear  that  o  does  not  depend  upon  n  .  It  is 
Just  the  probability  of  exactly  v  cycles  resulting  from  u  cyclic 
elements.  In  fact,  we  may  show  (Rlordan  p.  70-72)  that 

a(u,v)  -  <-l)U+V  s(u,v)/u! 

where  s(u,v)  are  Stirling  numbers  of  the  first  kind. 
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0(1,1)  -  1 

a (2,1)  -  1/2  a(2,2)  -  1/2 

0(3,1)  «  1/3  a(3,2)  -  1/2  a(3,3)  -  1/6  . 

More  generally  o(u,l)  -  ^  ,  d(u,u)  -  ~  and  using  the  familiar  recurrence 
relationship  for  Stirling  numbers  of  the  first  kind  (Riordan  p.  33) 

(39)  a(u,v  )  ■  -  a(u-lrv  )  +  jj  a(  u-l,v~l  )  . 


Rubin  and  Sitgreaves  tabulate  a(u,v)  for  u,v  *  1,2,..., 25,  u£v  . 

The  distribution  of  Vn  is  obtained  in  a  more  complicated 
form  than  (38)  by  Folkert  using  the  aforementioned  Katz  Identity. 
Using  ( 111 )  and  (38)  the  identity  (^0)  ensues 


(*»(>) 


n 

r 

u*l 


u  nu 


n  n 

£  £  o  ( «,v  ) 

v»l  u«v 


(n)uuv 


n  (n) 
E 


u=l  nu  n  v*l 


U  ^  E  v  o  (  u ,  v ) 


Next  the  exact  distribution  of  T  „  (eauivalently  „ 

n,r  n,r 

since  P(S  „  *  kr)  *  P(T  *  k)  )  is  obtained  from  U„  . 

n,r  n,r  n 


n 

P(Tn  r  *  k)  "  1  P(Tn,r  *  k*Un  *  u)  P(Un  “  u) 


(*1) 


n  (n)  u 

E  B  (r,k,u)«  U+1 

u»kr  n 


1 
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How  8  does  not  depend  on  n  .  It  Is  Just  the  probability 
of  exactly  k  cycles  of  length  r  resulting  from  u  cyclic 
elements.  It  is  not  hard  to  show  that 

(^1)  8(r,k,u)  =  — ~  B(r,0,u-kr)  . 

k !  r 

[w/r] 

Since  0(r,O,w)  =  1  -  E  0(r,k,w)  and  since  8(r,0,w)  *  1 

k  =  l 

when  w  <  r  ,  8(r, k,u)  can  be  obtained  recursively.  Also 

0(r,l,r)  =  a(l,r)  =  1/r  and  8(1, r,r)  =  n(r,r)  =  1/r! 

It  is  apparent  that  with  the  exception  of  Un  ,  these  exact 
distributions  are  a  bit  inconvenient.  In  the  next  section  we  obtain 
some  simple  asymptotic  distributions. 

In  concluding  this  section  we  examine  the  expected  length  of 
a  cycle  denoted  by  F.CL.  We  first  compute  the  likelihood  of  any 
particular  cycle  space  configuration  under  a  random  T  .  If  we 
let  m ^  be  the  number  of  cycles  of  length  t  ,  £  =  l,...,n  ,  and 

let  nig  3  n  -  =  the  number  of  transient  states,  then  for 

Em^fc  <  n 

P(m^  cycles  of  length  i  and  transient  states) 

-  P(mj,m2»"*.,m^) 

-  . m2|Un-n-«0)  P(Un-n-m0) 

i  (n>ll-»o<n'*o) 

■  -  - - -  •  - : - 

n-mn  n-m-  n« 

H  0  n# !  II  0  *  *  n  U 

1*1  1*1 
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n!  (d-uIq) 

n-mn  m.  n-mn  n-mQ+l 

n°JlX'  n°m,!n 


0»i/en  any  vector  (m^, . . . ,mn)  such  that  >  0  and 

Lm.l  <  ;  the  average  cycle  length  for  the  cycle  space  configuration 
it  defines  is  (Zm^)-1  Zm^A  . 

Hence 


(*3) 


ECL  *  Z  (Zm^) 


-1 


Zm^l  •  PCm^m^, . . .  ,mn) 
{(m1,m2>. . .  ,mn)*ZmJl<l,mjt>0> 


Continuing  we  note  that  Zm^i  is  a  value  of  Un  and  Zm^  is 

a  value  of  V  and  thus 
n 


ECL  «  E  (^p)  . 

n 

Using  the  joint  distribution  of  Un,  Vn  contained  in  (38),  we 

have 


<«*> 


n  n 
ECL  ■  Z  Z 
v-1  u»v 


-  a(u»v  ) 


(n)uu 

nu+1 


n  u  u 

Z  Z  S-  a(u,v  ) 

U»1  V»1 


(n)uu 
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The  equality  of  the  right  hand  sides  of  (43)  and  (44)  provides 
yet  another  identity.  A  more  convenient  expression  for  studying 
FCL  may  be  obtained  using  the  recursion  relation  (39).  That  is, 


E<V 


n  u  (n)  u 

E  E  v  a(u.v)  — TI 


u«l  v-1 


n  u 

E  E  v[  (u-1  )a(  u-l,v  )  +  a(u-l,v-l  )] 
U*1  v*l 


n  (n) 

E  -T7+T  *  (  (u-1  )E(  v  |  u-1 )  +  E(v+1 1  u-1)  } 
u*l  nu 

n  (n)  n  (n) 

\  -TOT  ♦  -W  “  E(v|u-1) 

u»l  n  u*l  n 

E(^-)  ♦  i  Efn-V  •  <V„  ♦  ^  )J  . 
n  *-  n 


After  some  simplification  we  have 


V  f  (U  +l)Vn  1  , 

E(tr>  ■  E|  "  n  ]-  • 

n  u  J  n 


Using  (35)  we  obtain 


E(fr)  “  b  E(U  V  +  V  -U  ) 
n  n  n  n  n 


whence 


ECL  >  n[E(UnVn  ♦ 
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6.  Asymptotic  Results 

Using  Harris'  idea  (p.  10^7 )  we  obtain  the  asymptotic  probability 

density  of  U  .  Letting  W  ■  U  /  /n  and  using  (33)  we  may  show 
n  n  n 

after  some  manipulation  that  Wn  converges  in  distribution  to  a 
random  variable  W  having  a  Rayleigh  distribution,  i.e.  the  density 
of  W  is 

-w2/2 

(^7)  f y( w)  ■  we  ,  w  >  0  . 

p 

This  also  establishes  that  Un  00  . 

It  is  easy  to  show  that 

E(Wr)  -  2r/2  f(^)  ,  r  >  -2  . 


Thus  for  k  >  -2 


E(n~k/2  Uk) 
n 


-k/2  ;  uk+1(n>u 

n  £ 


u®l  n 


u+1 


2k/2  r(^}  > 


In  particular  from  (35)  we  have 


U  , /0  n  (n)  u‘ 

(48)  E(--)  -  n_1/2  £  u 


/n 


u*l  n 


u+1 


-i/2  ;  (n,u 
n  £ 


u»l  n 


u 


n 


/i?72 


(offering  a  different  verification  of  our  limits  for  (12)  and  (13)), 
Furthermore,  in  agreement  with  our  remark  after  (37)  we  have 


-1  I  <n>u“3 
n  L  ..7 1 


u-1  n 


u+T 


♦  2  . 
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Expression  (48)  also  Implies  that  the  expected  number  of 
transient  states  approaches  •  as  n  -*■  »  ,  i.e. 


E(n-U_)  -/nE(/n~  —  )-*•«. 
n  /n 

U 

Additionally,  var(—  )  2  -  ir/2  confirming  that  var(U  )  -►  • 

✓n  n 

as  noted  after  (28).  As  for  var(Vn)  ,  using  (28),  it  is  clear  that 


which  is 


E(V=) 


n 

Z 

r*l 


Z 

r  ,s>l 


1  l*n)r+s 

r  s  .r+s 
n 


r+s<n 


<  E(Vn)  +  E(Un) 


<  2E(U  )  since  V  <  U  . 

—  n  n  —  n 

Hence  from  (48)  n-1E(V2)  -*■  0  implying  E(n_1^2Vn)  0  and 

_ i/p 

thus  that  var(n  V  )  •*  0  .  Similar  computation  leads  to  var(Vn)  » 
We  now  establish  that  as  n  ■*  ®  ,  ECL  ■*  «•  .  Consider 


E(UnV 


n  n 
I  Z  r~ 
r»l  s*l 


E(S  S  ) 
'  n,r  n,s' 


From  (10),  (21)  and  (23) 
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Hence 


E(S  S  )  = 
n,r  n,s 


f  (n) 


r+s 


n 


r  +  s 


*  r  /  s  ,  r  +  s  <  n 


0  ,  r  ?  s  ,  r  +  s  >  n 

(n)  (n). 


2r 


n 


(n). 


n 


2r 


r  =  s  ,  2r  <  n 


r  =  s  ,  2r  >  n 


E(Un  V 


r>l ,  s>l 
r  +  s<n 


-1  (n)r+s  n  (n)i 
r  — +  l  - l- 


n 


r+s 


r*l  n 


which  may  be  shown  to  be 


(*»9) 


<  n  E 


(1  *  lp6  »n) 
'  U  * 


+  E(U  ) 
n 


n 

Upon  dividing  by  n  both  terms  on  the  right-hand  side  of  (49) 

approach  o  •  For  the  first  we  use  the  boundedness  of  the  argument 

and  (47)  while  for  the  second  we  use  (48)  again.  As  a  result 

n  *E(Un  Vn)  -*■  0  so  that  from  (46)  ECL  -*■  °*  . 

We  next  argue  that  the  asymptotic  distribution  of  T  (i.e. 

S  n»r 

)  is  Poisson  with  mean  1/r  .  The  limits  in  (11)  and  (24) 

encourage  this  possibility.  It  suffices  to  show  that 


(50)  lira  [k!r  P(T  -  k)  -  P(T  -  0)] 
n  -  -  n'r  n*r 


1  >  2 } . . . 
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From  (40)  and  (41)  we  may  write 


P  (T 


n,r 


k) 


n-kr 

E  B(r,0,u) 
u=0 


(n)u+kr(u+kr) 


u+kr+1 


n 


Hence  the  left-hand  side  of  (50)  becomes 


n  (n)  u  n-kr 

11m  [  E  B(r,0,u)  — ~ y  -  E  3(r,0,u) 
n  »  u=l  n  u=0 


(n) 

n 


u+kr 


(u+kr ) 


u+kr+1 


] 


n-kr 

*  11m  [  Z  B(r,0,u)u( 

n  -*•  00  u=l 


(n). 


.u+1 


(n)u+kr> 

u+kr+1 1 
n 


n  (n)  u 

♦  I  6(r,0,u)  -jHj 
u=n-kr+l  n 


n-kr 
-  kr  Z 
u=0 


(n) 


u+kr 


u+kr+1 


n 


(n)kr(kr) 

nkr+1" 


]  • 


It  is  apparent  that  the  limits  of  the  second,  third,  and  fourth 
terms  within  the  brackets  are  0  .  Since  B(r,0,u)  <  1  and  since 


n  (n )  u 

llm  Z  uTT 
n  -*■  «»  u=a  n 


llm 
n  -*•  ® 


n-a 

E 

u-1 


(n)uu 

nu+1 


1 


for  any  fixed  positive  integer  a  ,  the  first  term  also  tends  to  0 
and  we  are  done . 

Summarizing,  Tn  p  converges  in  distribution  to  a  random  variable 

T  such  that 
r 


P(T  -  t)  -  — t -  ,  t  -  0,1,2 . 

r  r*ti 

(The  limiting  Poisson  distribution  when  r  *  1  was  noted  at  the 
beginning  of  section  3.) 
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It  is  well-known  that  if  X  Pq(a)  ,  then  E(X)k  *  Ak  (see 
e.g.  Johnson  and  Kotz  (1969).  p.  90)  from  which 

k  k  1 

E(Xk)  »  E  S(k,J)AJ 

J-l 

where  the  S(k,J)  are  Stirling  numbers  of  the  second  kind.  Hence 

k  k  - 1 

(51)  E(T  )K  -  E  S(k,J)r  J  . 

n,r  J=1 

We  calculate  the  left-hand  side  of  (51)  assuming  n  >  k 


E(T  )k  =  r"k  E (  E  D"  )k 
n»r  1=1  ri 

*  r"k  k  E  n(D?i)ki 

where  =  { (k^ , . . . ,kn) :  ^  >  0  ,  E  k^  *  k)  . 

But  if  exactly  m  of  the  k.  ^  0  ,  E  II(Dr.  *  '  *  P  given  by 

l  r  %  n,m,r  ° 

(29).  Continuing  then 


E(Tn,r) 


P 


n,m,r 


k_I 

Rk1! 


where  Y?  denotes  the  subset  of  on  which  exactly  m  of  the  k  ’s  are>0.  But  the  sum 
m 

over  is  merely  the  number  of  ways  of  placing  k  objects  into 

n  cells  such  that  exactly  m  are  nonempty.  This  number  is 
(n)m  S(k,m)  (Riordan,  p.  92)  whence 


E(Tn,r> 


-k 


k 

l 

m»l 


S(k,m)(n)_  P 


m  n,m,r 


25 


Using  (30)  we  have 


(52)  lim  E(T  Jk  ■  r"k  E  S(k,m)  E  n(m  . m.)  • 

"’r  «L,r  1  J 

1  3  -1 

[(r-l)']J[  it  (r-m)!]  A  . 

i-1 

Denoting  the  sum  over  J  r  ^y  m  anc*  ecluatin8  right-hand 
sides  in  (51)  and  (52),  we  find  the  identity 

k  j,  m  k 

(53)  E  S (k  ,m)rK-m  -  E  S(k,m)A  m  . 

m=l  m=l  r’m 

Note  that  A.  *  1  reduces  (53)  to  a  triviality. 

1  ,m 

7.  Summary 

In  the  previous  sections  we  have  rather  thoroughly  described 
the  behavior  of  the  cycle  space  of  a  randomly  selected  transformation 
on  a  finite  set.  Amongst  the  most  interesting  conclusions  are  the 
"large  set"  results.  We  have  demonstrated  that  with  increasing  set 
size 

(i)  the  expected  number  of  cyclic  states  •  . 

(li)  the  expected  number  of  transient  states  •  . 

(iii)  the  expected  number  of  cycles  -*■  •  . 

(iv)  the  likelihood  that  any  particular  state  is  cyclic  0  . 

(v)  the  expected  number  of  cycles  of  length  r  1/r  . 

(vi)  the  expected  number  of  states  on  cycles  of  length  r  1  . 

(vii)  the  expected  cycle  length  -*•  *  . 


As  a  final  remark,  suppose  the  set  of  transformations  is 
restricted  to  be  into  a  subset  of  X  ,  say  X'  ,  having  n'  elements. 
After  the  first  transition,  all  of  the  results  of  the  preceding 
sections  apply  with  n*  replacing  n  . 


References 


Cull,  P.  (1977).  "A  Matrix  Algebra  for  Neural  Nets"  presented  at  the 
International  Conference  on  Applied  General  Systems  Research, 
August  1977,  Binghampton,  N.Y. 

Folkert,  J.E.  (1955).  "The  Distribution  of  the  Number  of  Components 
of  a  Random  Mapping  Function"  unpublished  Ph.D.  Dissertation, 
Michigan  State  University. 

Gontcharoff,  W.  (1944).  "On  the  Field  of  Combinatory  Analysis" 

Bull,  de  l'Academie  des  Sciences  de  U.R.S.S.,  Serie  Mathematique 
Vol .  8,  p.  1-48. 

Harris,  B.  (i960).  "Probability  Distributions  Related  to  Random 
Mappings"  Annals  Math.  Stat.,  Vol.  31,  No.  4,  p.  1045-1062. 

Johnson,  N.  and  S.  Kotz  (1969).  Discrete  Distributions,  Houghton- 
Mifflin,  Boston. 

Rubin,  H.  and  R.  Sitgreaves  (1954).  "Probability  Distributions  Related 
to  Random  Transformations, on  a  Finite  Set"  Tech.  Report  U  19A, 
Applied  Math,  and  Stat.  Lab.,  Stanford  University. 

Riordan,  J.  (1958).  An  Introduction  to  Combinatorial  Analysis,  J.  Wiley 
&  Sons,  New  York. 


27 


SECURITY  CLASSIFICATION  OF  THIS  RACK  (Milan  I 


REPORT  DOCUMENTATION  PAGE 


4.  title  !an*  SuHiihi 

ON  THE  CYCLIC  BEHAVIOR  OF  RANDOM  TRANSFORMA¬ 
TIONS  ON  A  FINITE  SET 


READ  INSTRUCTIONS 
BEFORE  COMPLETING  FORM 


T  I  CATALOG  NUMBER 


s.  type  of  report  a  perioo  covereo 

TECHNICAL  REPORT 


performing  oro.  report  numecn 


7.  AUTHOR!*; 


ALAN  E.  GELFAND 


CONTRACT  OR  GRANT  NUMBER!*; 

N0001 4-76-C-0475 


t.  performiho  oroaniiation  name  ano  aooreu 

Department  of  Statistics 
Stanford  University 

Stanford,  CA  94305  _ 


n.  controlling  office  name  ano  aooress 

Office  Of  Naval  Research 

Statistics  &  Probability  Program  Code  436 

K  1  • _ . _  lift  Artm  *t 


PROGRAM  ELEMENT.  PROJECT,  TAM 
AREA  A  PORK  UNIT  NUMBERS 

NR-042-267 


I*.  REPORT  OATS 


AUGUST  4,  1981 


I 


Arlington,  VA  22217 . . . . _  . 


MONITORING  AGENCY  name  A  ADDRESS!'!  ««m*l  Im  Can tnlling  Of/lea;  IS.  SECURITY  CLASS.  |al  (Ala  npsHJ 

UNCLASSIFIED 


IS.  DISTRIBUTION  STATEMENT  !af  in'*  R*p*n; 


APPROVED  FOR  PUBLIC  RELEASE:  DISTRIBUTION  UNLIMITED. 


17.  DISTRIBUTION  STATEMENT  !af  Hi*  akatracl  antaraO  M  Black  70.  II  MHarani  kaai  Rapatt; 


ft.  KEY  WORDS  (Continue  mi  mmth  It  MCMMry  mi 4  tdmtttf  by  bloc*  inmIit) 

Random  transformations;  cycle;  cycle  length;  exchangeable  random 
variables;  finite  state  systems. 


20.  a*S1  R  ACT  !C«n!lnu*  on  rama  *10*  II  nacaaaaar  an*  ISanlllF  Or  Slack  — Aar; 

PLEASE  SEE  REVERSE  SIDE. 


DD  I  jan-77  1473  EOITION  OF  I  NOV  AS  IS  OBSOLETE 

S/N  07  02*  L?*  51 4*  S401 


UNCLASSIFIED 

SECURITY  CLASSIFICATION  OF  THIS  PAGE  !»k*n  Oa»a  I 


_ UNCLASSIFIED _ 

WCUWTY  ClAWrtCATWW  OF  THU  »A8«  (Wkm  Bm»  tK~m*C 

#305 

ON  THE  CYCLIC  BEHAVIOR  OF  RANDOM  TRANSFORMATIONS 
ON  A  FINITE  SET 

Let  X  be  a  finite  set  of  elements  and  let  3  be  the  set 

of  all  transformations  from  X  into  itself.  For  T  e  3  we  take 
1/ 

T  to  have  its  usual  meaning.  Starting  from  a  given  x  e  X 

consider  the  sequence  TJx,  j  =  0,1,2 .  Since  X  is  finite 

the  sequence  T.  must  eventually  encounter  an  element  It  had  shown 

J 

before.  Thereafter  it  must  repeat  this  intermediate  sequence  of 
elements.  Such  a  sequence  is  called  a  cycle  and  the  number  of 
distinct  elements  in  the  cycle  is  called  the  cycle  length.  For 
a  given  T,  not  all  x's  must  be  on  a  cycle  and,  moreover, 
starting  from  differing  x's  may  lead  T  into  differing  cycles. 
Hence  we  have  the  notion  of  a  cycle  space  for  T. 

It  is  the  purpose  of  this  paper  to  discuss  a  collection  of 
exact  and  asymptotic  results  describing  the  cycle  space  of  a 
randomly  selected  T.  In  particular,  we  examine  such  variables 
as  the  number  of  elements  on  a  cycle  of  a  specified  length,  the 
number  of  elements  on  cycles,  the  number  of  cycles  and  the  length 
of  a  cycle. 
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